
an orientation sensor coupled to said image sensor, for generating a signal 

corresponding to the position of the image sensor relative to said object; 
a memory, having an auto-rotate unit comprising program instructions for selectively 

transforming said captured image data into rotated image data in response to 

said position signal, said memory coupled to said image sensor and to said 

orientation sensor; and 
an image processing unit coupled to said memory for executing program instructions 

stored in said memory; and 
wh e rein (a) said image processing unit proc e ss e s an i by j array of said captur e d 

imag e data and said image s e nsor gonorat e s on i+1 by j+1 array of said imag e 

data, or (b) 

an image capture unit generates an additional row and column of pixels for said 
captured image data from said image sensor. 

2. (Original) The apparatus of claim 1, wherein the memory further comprises: 

an image processing unit comprising program instructions for transforming one from 



3. (Original) The apparatus of claim 1, wherein: the signal is a portrait_left signal if the 
image sensor is rotated clockwise from a landscape orientation relative to the object, and the 
signal is a portrait_right signal if the image sensor is rotated counter-clockwise from the 



the auto-rotate unit comprises program instructions for transforming the captured 

image data into portrait_left image data in response to the portrait_left signal 
and into portrait_right image data in response to the portrait_right signal. 

4. (Original) The apparatus of claim 1, wherein: 

the signal is a landscape signal if the image sensor is positioned in a level orientation 

relative to the object; and 
the auto-rotate unit comprises program instructions for transforming the captured 

image data into landscape image data in response to the landscape signal. 



a group consisting of capUired image data and portrait image data, into 
processed image data. 



landscape orientation relative to the object; and 



App. No. 10/040,249 



2 



1 8602/0661 4/SF/5 103 195. 1 



5. (Original) The apparatus of claim 3, wherein: 

the image sensor has a top, a bottom, a right side and a left side; 

the auto-rotate unit program instructions transform the captured image data into the 
portrait left image data by transferring a prior portrait_left line of image data 
which starts further toward the bottom of the image sensor and ends further 
toward the top of the image sensor, then transferring a subsequent portrait_left 
line of image data, located closer to the right side of the image sensor than the 
prior portraitjeft line of image data, and also starting further toward the 
bottom of the image sensor and ending further toward the top of the image 
sensor; and 

the auto-rotate unit program instructions transform the captured image data into the 
portrait right image data by transferring a prior portrait_right line of image 
data which starts further toward the top of the image sensor and ends further 
toward the bottom of the image sensor, then transferring a subsequent 
portrait right line of image data, located closer to the left side of the image 
sensor than the prior portrait_right line of image data, and also starting further 
toward the top of the image sensor and ending further toward the bottom of 
the image sensor. 

6. (Original) The apparatus of claim 4, wherein: 

the image sensor has a top, a bottom, a right side and a left side; and 
the auto-rotate unit program instructions transform the captured image data into the 
landscape image data by transferring a prior landscape line of image data 
which starts further toward the left side of the image sensor and ends further 
toward the right side of the image sensor, then transferring a subsequent 
landscape line of image data, located closer to the bottom of the image sensor 
than the prior landscape line of image data, and also starting further toward 
the left side of the image sensor and ending further toward the right side of the 
image sensor. 
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7. (Original) The apparatus of claim 3, wherein: 

the portrait_left signal is generated by the orientation sensor if the image sensor is 
rotated approximately 45° clockwise from the level orientation, and the 
portrait right signal is generated by the orientation sensor if the imaging 
subsystem is rotated approximately 45° counter-clockwise from the level 
orientation. 

8. (Original) The apparatus of claim 5, wherein: 

the prior portrait_left line of image data and the prior portrait_right line of image data 

comprise a "green, red, green, red" pixel pattern; and 
the subsequent portrait_Ieft line of image data and the subsequent portrait_right line 

of image data comprise a "blue, green, blue, green" pixel pattern. 

9. (Allowed) An apparatus for rotating a display orientation of multicolor captured image 
data having an i-by-j pixel matrix with a pattern representative of an object, comprising: 



an image sensor, for generating the multicolor captured image data; 

an input device, for generating a portrait_left signal in response to a first user 

selection, a portrait_right signal in response to a second user selection, and a 

landscape signal in response to a third user selection; 
a memory, having: 

an auto-rotate unit comprising program instructions for selectively transforming the 
multicolor captured image data into portrait_left image data in response to the 
portrait-left signal, portrait right image data in response to the portrait right 
signal, and landscape image data in response to the landscape signal; and 

an image processing unit comprising program instructions for transforming the 

portrait_left image data, the portrait_right image data and the landscape image 
data into processed image data; and 

a processing unit, coupled to the image sensor, to the input device, and to the 
memory, for executing program instructions stored in the memory; 

wherein said image processing unit changes the number of pixel rows and pixel 
columns of the multicolor captured image data such that, from a defined 
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referenced viewpoint, the portrait left image data, the portrait right image data, 
and the landscape image data, each includes the an (i-l)-by-(j-l) pixel matrix 
having said pattern. 

10. (Allowed) The apparatus of claim 9, wherein the image processing unit has a first line 
length for processing the portrait_left image data and the portrait_right image data and a second 
line length for processing the landscape image data. 

1 1 . (Currently amended) A method for rotating a display orientation of image data 
representative of an object, comprising the steps of: 

generating image data with an image sensor; 

identifying an orientation of the image sensor relative to the object at a time 

substantially simultaneous with the generating step, where said identifying is 
performed by an orientation sensor; and 

selectively transferring data to an image processing unit in response to the identifying 
step; 

wherein said image processing unit rotates said display orientation of said image data 
and (a) said imag e processing unit proc e sses an i by j array of said captured 
image data and said imag e sensor g e n e rat e s an i+1 by j+1 array of said imag e 
data, or (b) an imag e captur e unit g e n e rat e s bv generating an additional row 
and column of pixels for said captured image data from said image sensor. 

12. Cancelled. 

13; (Original) The method of claim 11, further comprising the step of correcting defects 
within the image data caused by defects within the image sensor. 

14. (Original) The method of claim 11, wherein the image sensor comprises a top, a right 
side and a left side, wherein the image comprises a "top portion," and wherein the step of 
identifying an orientation further comprises the steps of: 

identifying a portrait_left orientation, if the left side of the image sensor corresponds 
to the "top portion" of the object; 
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identifying a portrait_right orientation, if the right side of the image sensor 

corresponds to the "top portion" of the object; and 
identifying a landscape orientation, if the top of the image sensor corresponds to the 

"top portion" of the obj ect. 



15. (Original) The method of claim 11, wherein the step of identifying an orientation 
fixrther comprises the steps of: 

identifying a portrait_left orientation, in response to a user selection of the 

portrait_left orientation on an input device; 
identifying a portrait_right orientation, in response to a user selection of the 



identifying a landscape orientation, in response to a user selection of the landscape 
orientation on the input device. 



16. (Original) The method of claim 11, wherein the orientation is a portrait_left 
orientation, wherein the image data is comprised of an array of pixel colors ordered in rows and 
columns, and wherein the step of selectively transferring comprises the steps of: 



initializing a column variable to a first column of pixel colors required by the image 
processing unit; 

initializing a row variable to a row containing a first pixel color required by the image 
processing unit; 

transferring pixel color at an array location defined by the row variable and the 

column variable to and the image processing unit; 
decrementing the row variable to a row containing a next pixel color required by the 

image processing unit; 
retuming to the transferring step, if a row containing a last pixel color has not been 

transferred; 

incrementing the colunrn variable to a next column of pixel colors required by the 

image processing unit; and 
retuming to the initializing a row variable step, if a last column of pixel colors has not 

been transferred. 



portrait_right orientation on the input device; and 
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17. (Original) The method of claim 16, wherein the image data is replaced by defective 
image sensor information, further comprising the step of repeating the steps of claim 16. 

18. (Original) The method of claim 16, fixrther comprises the steps of: 
configuring the image processing unit to accept an image data line length 

corresponding to the portrait_left orientation; and 
performing image processing on a line of transferred image data. 

19. (Original) The method of claim 11, wherein the orientation is a portrait_right 
orientation, wherein the image data is comprised of an array of pixel colors ordered in rows and 
columns, and wherein the step of selectively transferring comprises the steps of: 

initializing a column variable to a first column of pixel colors required by the image 
processing unit; 

initializing a row variable to a row containing a first pixel color required by the image 
processing unit; 

transferring pixel color at an array location defined by the row variable and the 

colmnn variable, to the image processing unit; 
incrementing the row variable to a row containing a next pixel color required by the 

image processing unit; 
returning to the transferring step, if a row containing a last pixel color has not been 

transferred; 

decrementing the column variable to a next column of pixel colors required by the 

image processing unit; and 
returning to the initializing a row variable step, if a last column of pixel colors has not 

been transferred. 

20. (Original) The method of claim 11, wherein the orientation is a landscape orientation, 
wherein the image data is comprised of an array of pixel colors ordered in rows and columns, 
and wherein the step of selectively transferring further comprises the steps of: 

initializing a row variable to a first row of pixel colors required by the image 
processing unit; 
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initializing a column variable to a column containing a first pixel color required by 

the image processing unit; 
transferring pixel color at an array location defined by the row variable and the 

column variable, to the image processing unit; 
incrementing the column variable to a column containing a next pixel color required 

by the image processing unit; 
returning to the transferring step, if a column containing a last color pixel has not 

been transferred; 

incrementing the row variable to a next row of pixel colors required by the image 
processing unit; and 

retuming to the initializing a column variable step, if a last row of pixel colors has not 
been transferred. 

21. (Original) An apparatus for rotating a display orientation of multicolor image data 
having an i-by-j pixel matrix with a pattern representative of an object, comprising: 

means for generating multicolor image data with an image sensor; 

orientation sensor means for identifying an orientation of said image sensor relative to 
said object at a time substantially simultaneous with said generating said 
multicolor image data; and 

means for selectively transferring said multicolor image data to an image processing 
unit in response to said means for identifying; 

wherein said image processing unit rotates said display orientation of said multicolor 
image data for providing rotated multicolor image data, and changes the 
number of pixel rows and pixel columns of said multicolor image data such 
that, fi-om a defined referenced viewpoint, said rotated multicolor image data 
includes having an (i-l)-by-(j-l) pixel matrix said pattem. 

22. (Original) The apparatus of claim 21, further comprising means for generating an 
additional row and column of image data. 

23. (Original) The apparatus of claim 21, further comprising means for correcting defects 
within the image data caused by defects within the image sensor. 
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24. (Original) The apparatus of claim 21, wherein the image sensor comprises a top, a 
right side and a left side, wherein the image comprises a "top portion," and wherein the means 
for identifying an orientation ftirther comprises: 

means for identifying a portrait_left orientation, if the left side of the image sensor 

corresponds to the "top portion" of the object; 
means for identifying a portrait_right orientation, if the right side of the image sensor 

corresponds to the "top portion" of the object; and 
means for identifying a landscape orientation, if the top of the image sensor 

corresponds to the "top portion" of the object. 

25. (Original) The apparatus of claim 21, wherein the orientation is a portrait_left 
orientation, wherein the image data is comprised of an array of pixel colors ordered in rows and 
columns, and wherein the means for selectively transferring comprises: 

means for initializing a column variable to a first column of pixel colors required by 

the image processing unit; 
means for initializing a row variable to a row containing a first pixel color required by 

the image processing unit; 
means for transferring pixel color at an array location, defined by the row variable 

and the column variable, to the image processing unit; 
means for decrementing the row variable to a row containing a next pixel color 

required by the image processing unit; 
means for returning to the means for transferring, if a row containing a last pixel color 

has not been transferred; 
means for incrementing the column variable to a next column of pixel colors required 

by the image processing unit; and 
means for returning to the means for initializing a row variable, if a last colmnn of 

pixel colors has not been transferred. 

26. (Original) The apparatus of claim 21, wherein the orientation is a portrait_right 
orientation, wherein the image data is comprised of an array of pixel colors ordered in rows and 
columns, and wherein the means for selectively transferring comprises: 
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means for initializing a column variable to a first colunrn of pixel colors required by 

the image processing xmit; 
means for initializing a row variable to a row containing a first pixel color required by 

the image processing unit; 
means for transferring pixel color at an array location, defined by the row variable 

and the column variable, to the image processing unit; 
means for incrementing the row variable to a row containing a next pixel color 

required by the image processing unit; 
means for returning to the means for transferring, if a row containing a last pixel color 

has not been transferred; 
means for decrementing the column variable to a next column of pixel colors required 

by the image processing unit; and 
means for returning to the means for initializing a row variable, if a last column of 

pixel colors has not been transferred. 

27. (Original) The apparatus of claim 21, wherein the orientation is a landscape 
orientation, wherein the image data is comprised of an array of pixel colors ordered in rows and 
columns, and wherein the means for selectively transferring comprises: 

means for initializing a row variable to a first row of pixel colors required by the 

image processing unit; 
means for initializing a column variable to a column containing a first pixel color 

required by the image processing unit; 
means for transferring pixel color at an array location, defined by the row variable 

and the column variable, to the image processing unit; 
means for incrementing the column variable to a column containing a next pixel color 

required by the image processing unit; 
means for returning to the means for transferring, if a column containing a last color 

pixel has not been transferred; 
means for incrementing the row variable to a next row of pixel colors required by the 

image processing unit; and 
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means for returning to the means for initializing a column variable, if a last row of 
pixel colors has not been transferred. 

28. (Original) A computer useable medium embodying computer readable program code 
for causing a computer to rotate a display orientation of multicolor image data having an i-by-j 
pixel matrix with a pattem representative of an object, by performing steps comprising: 

generating said multicolor image data with m image sensor; 

identifying an orientation of the image sensor relative to the object at a time 

substantially simultaneous with the generating step, wherein said identifying 
of said orientation is performed with an orientation sensor; and 

selectively transferring image data to an image processing unit in response to the 
identifying step, 

wherein said image processing unit rotates said display orientation of said multicolor 
image data for providing rotated multicolor image data, and changes the 
number of pixel rows and pixel colunms of said multicolor image data such 
that, from a defined referenced viewpoint, said rotated multicolor image data 
includes having an (i- 1 )-by-(j - 1 ) pixel matrix said pattem. 

29. (Original) The computer useable medium of claim 28, further comprising program 
code for generating an additional row and column of image data. 

30. (Original) The computer useable medium of claim 28, further comprising program 
code for correcting defects within the image data caused by defects within the image sensor. 

31. (Original) The computer useable medium of claim 28, wherein the image sensor 
comprises a top, a right side and a left side, wherein the image comprises a "top portion,", and 
wherein the program code for performing the step of identifying an orientation further comprises 
program code for: 

identifying a portrait_left orientation, if the left side of the image sensor corresponds 

to the "top portion" of the object; 
identifying a portrait_right orientation, if the right side of the image sensor 

corresponds to the "top portion" of the object; and 
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identifying a landscape orientation, if the top of the image sensor corresponds to the 
"top portion" of the object. 

32. (Original) The computer useable medium of claim 28, wherein the orientation is a 
portrait_left orientation, wherein the image data is comprised of an array of pixel colors ordered 
in rows and columns, and wherein the program code for performing the step of selectively 
transferring comprises program code for: 

initializing a column variable to a first column of pixel colors required by the image 
processing unit; 

initializing a row variable to a row containing a first pixel color required by the image 
processing unit; 

transferring pixel color at an array location, defined by the row variable and the 

column variable, to the image processing unit; 
decrementing the row variable to a row containing a next pixel color required by the 

image processing unit; 
returning to the transferring step, if a row containing a last pixel color has not been 

transferred; 

incrementing the column variable to a next column of pixel colors required by the 

image processing unit; and 
returning to the initializing a row variable step, if a last column of pixel colors has not 

been transferred. 

33. (Original) The computer useable medium of claim 28, wherein the orientation is a 
portrait right orientation, wherein the image data is comprised of an array of pixel colors ordered 
in rows and columns, and wherein the program code for performing the step of selectively 
transferring comprises program code for: 

initializing a column variable to a first column of pixel colors required by the image 
processing unit; 

initializing a row variable to a row containing a first pixel color required by the image 
processing unit; 
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transferring pixel color at an array location, defined by the row variable and the 

column variable, to the image processing unit; 
incrementing the row variable to a row containing a next pixel color required by the 

image processing unit; 
returning to the transferring step, if a row containing a last pixel color has not been 

transferred; 

decrementing the column variable to a next column of pixel colors required by the 

image processing unit; and 
returning to the initializing a row variable step, if a last column of pixel colors has not 

been transferred. 

34. (Original) The computer useable medium of claim 28, wherein the orientation is a 
landscape orientation, wherein the image data is comprised of an array of pixel colors ordered in 
rows and columns, and wherein the program code for performing the step of selectively 
transferring comprises program code for: 

initializing a row variable to a first row of pixel colors required by the image 
processing unit; 

initializing a column variable to a column containing a first pixel color required by 

the image processing unit; 
transferring pixel color at an array location, defined by the row variable and the 

column variable, to the image processing unit; 
incrementing the column variable to a column containing a next pixel color required 

by the image processing unit; 
returning to the transferring step, if a column containing a last color pixel has not 

been transferred; 

incrementing the row variable to a next row of pixel colors required by the image 
processing unit; and 

retuming to the initializing a column variable step, if a last row of pixel colors has not 
been transferred. 
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35. (Original) An apparatus for rotating a display orientation of multicolor captured 
image data having an i-by-j pixel matrix with a pattem representative of an object, comprising: 

an image sensor, for generating said multicolor captured image data; 

an orientation sensor coupled to said image sensor, for generating a signal 

corresponding to the position of said image sensor relative to said object; and 
a hardware device, having an auto-rotate unit comprising circuits for selectively 

transforming said multicolor captured image data into rotated multicolor 

image data in response to said position signal, said hardware device coupled 

to said image sensor and to said orientation sensor; 
wherein, from a defined referenced viewpoint, said rotated multicolor image data 

includes an (i- 1 )-by-(j - 1 ) pixel matrix having said pattem. 

36. (Currently amended) An apparatus for rotating a display orientation of captured 
image data representative of an object, the apparatus comprising: 

an image sensor, for generating said captured image data; 

an input device, for generating an orientation signal in response to a user selection; 
a memory, having an auto-rotate unit for selectively transforming said captured image 

data into rotated image data in response to said orientation signal from said 

input device; and 

an image processing unit coupled to said memory for processing the image dataf 
_wh e r e in (a) said imag e s e nsor g e n e rat e s at l e ast on e mor e row and column of pixels 
than the imag e proc e ssing unit process e s or (b) an imag e capture unit gen e rat es bv 
generating at least one additional row and column of pixels for said captured image 
data from said image sensor. 

37. (Currently amended) A digital image capture device, comprising: 
an image sensor, for g e n e rating capturing image data; 

an orientation sensor, for generating an orientation signal indicating whether the 

image sensor is in a portrait or landscape positio n for automatically sensing 
th e ori e ntation of the imag e s e nsor relativ e to a ref e renc e ori e ntation and 
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g e n e rating an ori e ntation signal indicating th e ori e ntation of the imag e s e nsor 
relativ e to the r e f e r e nc e ori e ntation ; and 
an auto-rotate unit coupled to the image sensor and the orientation sensor, for 

automatically rotating the image data in response to the orientation signal 

38. (Original) The digital image capture device of claim 37, further comprising: 

an image processing unit coupled to the auto-rotate unit, for processing a subset of the 
rotated image data. 

39. (Original) The digital image capture device of claim 37, further comprising: 

an image capture unit coupled to the image sensor, for adding m additional rows and 
n additional columns to an i-by-j array of image data to form an i+m-by-j+n 
array of image data to be rotated by the auto-rotate unit in response to the 
orientation signal. 

40. (Currently amended) A method of rotating image data in a digital image capture 
device, comprising: 

capturing image data from an image sensor; 

automatically s e nsing th e ori e ntation of th e imag e se nsor relativ e to a r e f e r e nc e 

ori e ntation; 

providing an orientation signal indicating whether the image sensor is in a portrait or 
landscape position th e ori e ntation of the imag e s e nsor r e lativ e to th e r e f e r e nce 
ori e ntation ; and 

automatically rotating the captured image data in response to the orientation signal. 

41. (Original) The method of claim 40, wherein the rotating step further comprises: 
automatically rotating a subset of captured image data in response to the orientation 

signal. 

42. (Previously amended) The method of claim 40, further comprising: 

adding m additional rows and n additional columns to an i-by-j array of the image 
data to form an i+m-by-j+n array of image data. 
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43. (Currently amended) A computer-readable medium having stored thereon instructions 
which, when executed by a processor, cause the processor to perform the steps of: 

capturing image data from an image sensor; 

automatically s e nsing th e ori e ntation of th e imag e sensor r e lativ e to a r e f e r e nc e 

ori e ntation; 

providing an orientation signal indicating whether the image sensor is in a portrait or 
landscape orientation th e ori e ntation of th e imag e s e nsor r e lativ e to th e 
r e f e r e nc e ori e ntation ; and 

automatically rotating the captured image data in response to the orientation signal. 

44. (Original) The computer-readable medium of claim 43, wherein the rotating step 
further comprises: 

automatically rotating a subset of captured image data in response to the orientation 
signal. 

45. (Previously amended) The computer-readable medixmi of claim 43, further 
comprising: 

adding m additional rows and n additional columns to an i-by-j array of the image 
data to form an i+m-by-j+n array of image data. 

46. (Currently amended) A digital image capture device, comprising: 
image sensor means for generating image data; 

m e ans for automatically s e nsing th e orientation of th e image sensor r e lative to a 

r e f e r e nc e ori e ntation; 
means for generating an orientation signal indicating either a portrait orientation or a 

landscape orientation of the image sensor the orientation of th e imag e sensor 

relativ e to the refer e nc e ori e ntation ; and 
means for automatically rotating the image data in response to the orientation signal. 

47. (New) A digital image capture device, comprising: 

an image sensor, for generating said captured image data including a pluraUty of rows 
and columns of pixels; 
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an orientation sensor coupled to said image sensor, for generating a position signal 
indicating whether the image sensor is in a portrait or landscape position; 

a memory, having an auto-rotate unit comprising program instructions for selectively 
transforming said captured image data into rotated image data in response to 
said position signal by processing at least one row of pixels and at least one 
column of pixels less than the plurality of rows and columns of pixels in the 
captured image data, said memory coupled to said image sensor and to said 
orientation sensor; and 

an image processing unit coupled to said memory for executing the stored program 
instructions to rotate said capture image data. 

48. (New) A method for rotating a display orientation of image data, comprising: 
generating image data with an image sensor including a plurality of rows and 
columns of pixels; 

determining with an orientation sensor a portrait orientation or a landscape orientation 
for the image data substantially simultaneously with generating the image 
data; and 

processing the image data with an image processing unit in response to the orientation 
signal to rotate the image data, by rotating less than all of the plurality of rows 
and columns of pixels of the image data. 
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